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1 Introduction 



The study of the conjugate locus in Riemannian Lie groups of if-type has 
evolved in parallel with that in the ambient class of Riemannian 2-step 
nilpotent Lie groups. For a brief history of the latter see the introduction 
to [8]; here we shall give some for the groups of if- type. 

Groups of if-type were introduced by Kaplan in 1981 [11, 12]. A little 
later, Boggino in 1985 [2] found many of the conjugate points in a Reiman- 
nian group of if -type. In 1995, Berndt, Tricerri and Vanhecke [1] determined 
almost all of the conjugate points in Riemannian groups of if -type, and all 
of them when the center is 1-dimensional. They included determination of 
the multiplicities in most cases. Walschap in 1997 [15] showed that for Rie- 
mannian if- type groups, the cut locus is the conjugate locus. Finally, in 
unpublished work from 2001, Kim and Park [13] found explicit formulas for 
all the conjugate points in any Riemannian if- type group. A recent paper 
[6] determined all conjugate points in quaternionic Heisenberg groups with 
the Killing metric tensor from Sp(l,n). 

Using Ciatti's generalization of if -type to pseudoif-type [3], in this paper 
we shall determine explicit formulas for all conjugate points and their mul- 
tiplicities in the (larger) class of pseudofi-type, 2-step nilpotent Lie groups 
with a left-invariant pseudoriemannian (indefinite) metric tensor. When 
specialized to positive-definite metric tensors, we recover all the known Rie- 
mannian results for ii-type groups with shorter, simpler, more conceptual 
proofs. 

By an inner product on a vector space V we shall mean a nondegenerate, 
symmetric bilinear form on V, generally denoted by (,). Our convention 
is that v <G V is timelike if (v,v) > 0, null if (v,v) = 0, and spacelike if 
(v,v) < 0. 

Throughout, TV will denote a connected, 2-step nilpotent Lie group with 
Lie algebra n having center 3. We shall use ( , ) to denote either an inner 
product on n or the induced left-invariant pseudoriemannian (indefinite) 
metric tensor on N. We also assume that the center 3 is nondegenerate with 
respect to such a metric tensor. 

We denote the adjoint with respect to ( , ) of the adjoint representation 
of the Lie algebra n on itself by adt In the case of a nondegenerate center, 
the involution l of [4] is merely given by t(z a ) = e a z a and t(e a ) = e a e a 
where (z a ,z a ) = e a and (e a ,e a ) = e a on an orthonormal basis of n. Then 
the operator j : 3 — > End (0) is given by j(z)x = i&<r x iz. We refer to [4] and 
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[14] for other notations and results. 

For convenience, we shall use the notation J z = ad*, z for any z £ 3. 
(Since the center is nondegenerate, the involution l may be omitted.) We 
follow [3] for this next definition. As in the Riemannian case, one might 
as well make 2-step nilpotent part of the definition since it effectively is so 
anyway. 

Definition 1.1 N is said to be of pseudoii-type if and only if 

J 2 z =-(z,z)I 

for any z € 3. 

Lemma 1.11 collects some basic properties of these spaces. In Theorem 
2.3 we complete the determination of the conjugate locus for such groups; 
compare with Theorem 2.2 in [8]. Note that, in contrast to Theorem 2.4 
and Corollary 2.6 in [8], the center may now be of dimension greater than 
1. 

For //-type groups, the nonsingular condition was shown to be an impor- 
tant determining property of their geometries by Eberlein [5]. For pseudoii- 
type groups, however, it must be replaced by something better adapted 
to pseudoriemannian (indefinite metric tensor) geometries. Indeed, one 
may easily show that a nonsingular, pseudoii-type group necessarily has 
a (positive- or negative-) definite center. 

Definition 1.2 Let N be a pseudoriemannian, simply connected, 2-step 
nilpotent Lie group with Lie algebra n with nondegenerate center 3. We 
say that N is pseudoregular if and only if (1) ad x is surjective for every 
nonnull x € = 3 X , and (2) J z is nonsingular for every nonnull z G 3. 

Although (1) and (2) are equivalent in the Riemannian (definite) case, it is 
easy to show by examples that they are independent in general. It is not 
clear how this definition should be extended to handle a degenerate center. 
Similarly to the Riemannian case in which ii-type implies nonsingular, it is 
easy to see that pseudoii-type implies pseudoregular. 

In Theorem 2.4 we generalize Eberlein's Theorem 6.1 from [5] to pseu- 
doregular groups of pseudoii-type, obtaining essentially the same partial 
characterization of pseudoii-type in terms of the abundance of totally geo- 
desic submanifolds as Eberlein did there of ii-type. 

The rest of this Section consists of preliminaries and recollections. In 
Section 2 we state the main results and state and prove some secondary 
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results. Sections 3 and 4 are devoted to the proofs of the main Theorems 
2.3 and 2.4, respectively. 

We begin by specializing Theorems 3.1 and 3.6 of [4] to the case of a 
nondegenerate center. 

Proposition 1.3 For all z,z' G 3 and e, e! € X> we have 

V z z' = 0, 
V z e = V e z = -\J z e, 
V e e' = |[e,e']. 

Proposition 1.4 For all z, z', z" G 3 and e, e', e" G we have 

R(z,z')z" = 0, 

R(z, z')e = \{J z J z >e - J z >J z e) , 

R(z,e)z' = \J z J z ,e, 

R{z,e)e' = \[e,J z e'], 

R(e,e')z = -\([e,J z e'] + [J z e,e']), 

R(e,e')e" = \{J[ e , e "]e' - J[ e ', e "]e) + \J[ e , e j\e" . 

To study conjugate points, we use the Jacobi operator. 
Definition 1.5 Along the geodesic 7, the Jacobi operator is given by 

R.. =J R(., 7 ) 7 . 

In physics, this operator measures the relative acceleration produced by 
tidal forces along 7 [14, p. 219]. For the reader's convenience, we recall that 
a Jacobi field along 7 is a vector field along 7 which is a solution of the 
Jacobi equation 

VlY{t)+R i Y{t) = 

along 7. The point 7(to) is conjugate to the point 7(0) if and only if there 
exists a nontrivial Jacobi field Y along 7 such that Y(0) = Y(t ) = 0. 

Next, we specialize Proposition 4.8 of [4] to our present setting. As there, 
L n denotes left translation in N by n G N. 

Proposition 1.6 Let N be simply connected, 7 a geodesic with 7(0) = 1 G 
N , and 7(0) = z + x G n. Then 

j(t) = L l{t> (z + e tJ x ) 

where J = &d\ z . 
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As in [7], we shall identify all tangent spaces with tt = TiiV. Thus we regard 

7(t) = z + e tJ x 

as the geodesic equation. Using Proposition 1.4, we compute 

Lemma 1.7 77ie Jacobi operator along the geodesic ^ in N with 7(0) = 1 
and 7(0) = z + x a is given by 

Rj(z -\- x) ~^J[x,x']% -\- Z J x -^J J z x -^J X 
-\[x,Jx'\ + \[x',Jx\ + \[x',J z x'\ 

for all z G 3 and i£C, where x' = e tJ x and J = J Zo . □ 

For the reader's convenience, we provide the statement of Proposition 
2.1 from [8]. 

Proposition 1.8 Let j be a geodesic with 7(0) = 1 and 7(0) = z + ^0 € 
3 © = n. j4 vector field Y(t) = z(t) + e tJ u{t) along 7, where z(t) G 3 and 
£ for each t, is a Jacobi field if and only if 

z(t)-[e u u(t),x'(t)] =(, 
e tJ u{t) + e tJ Ju(t) - ad*, (t) C = , 

where x'{t) = e tJ x Q with J = J ZQ and Q G 3 is a constant. 

We also provide an adapted version of the statement of Theorem 2.2 from 
that paper. First we recall some notation. 

Definition 1.9 Let 7 denote a geodesic and assume that j(t ) is conjugate 
to 7(0) along 7. To indicate that the multiplicity of j(t ) is m, we shall 
write mult cp (t ) = m. To distinguish the notions clearly, we shall denote 
the multiplicity of A as an eigenvalue of a specified linear transformation by 
mult et , A. 

Let 7 be a geodesic with 7(0) = 1 and 7(0) = z + x G 3 © 0, respectively, 
and let J = J Zo . If 7 is not null, we may assume 7 is normalized so that 
(7>7) = il- A s usual, Z* denotes the set of all integers with removed. 

Theorem 1.10 Under these assumptions, if N is of pseudoH -type then: 
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1. if z = and x ^ 0, then j(t) is conjugate to 7(0) along 7 if and only 
if (x , x ) < and 

in which case mult cp (t) = dimj; 

2. if z 7^ and x = 0, then j(t) is conjugate to 7(0) along 7 i/ and only 
if (z , z ) > and 

Pol 

in which case mult cp (i) = dimtx 

Note that Parts 1 and 2 here correspond with Parts 2 and 3 there. Since 
we are assuming N is of pseudo-ff-type, J z = only for z = 0. Indeed, 
writing z = z t — z s where z t is timelike and z s is spacelike, it is immediate 
that Jf t / J| s whence J Zt / J Zs so J z / unless z = 0. Thus Part 1 of 
Theorem 2.2 in [8] cannot occur here, and we have restated the other two 
parts appropriately. 

Finally, here are some basic results on pseudoii-type spaces, useful for 
computations in them. 

Lemma 1.11 Let N be a group of pseudoH -type. Then these hold for all 
z, z' £ 1 and x,y £ 0: 

1. (J z x,J z ,x) = (z,z')(x,x); 

2. (J z x,J z y) = (z,z)(x,y); 

3. J Z J Z ,+J Z ,J Z = -2{z,z')I; 

4. [x,J z x] = {x,x)z . □ 
2 Main Results 

First, we present an example of a pseudo-ff-type group which is singular (not 
nonsingular), therefore not of -ff-type. 

Example 2.1 Let n be the following Lie algebra with indefinite form ( , ). 
We present it via a null basis for and an orthonormal basis for 3. 

n = lx u yi,Vi,Wi I 1 < i < kj \z u z 2 ,z^\ 
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where all the nontrivial inner products are given by 

(xi,Wi) = -l, {y u vi) = l 

= 1 = ~{z 2 ,z 2 ) = ~{z 3 ,z 3 ) . 
The structure equations are 

[Xi,Vi] = \{Zx - Z 2 ) , [Xi, Wi] = z 3 , 

[yuVi] = z 3 , [y u Wi] = 2(z 1 + z 2 ) , 

with all other brackets vanishing. The group N is the unique, simply con- 
nected, 2-step nilpotent Lie group with Lie algebra n. It is of pseudoii-type: 
a straightforward computation shows that ^21+622+023 = — (° 2 — b 2 — c 2 )I as 
required. It is easy to verify that it is singular. 

The main difference between pseudoii-type and H-type is that J z can 
drop rank on null vectors. This can be quantified. 

Proposition 2.2 Let N be of pseudoH -type with Lie algebra n = 3 © 0. 
Then dimt) is even and rk J z = ^dimo for nonzero null z. 

Proof: Choose a nonnull z G 3. First, assume (z, z) = A 2 > 0, so 
J 2 = —X 2 I. Now choose a unit (timelike or spacelike) e\ E 0; then e\ _!_ J z e\. 
Next, choose a unit (timelike or spacelike) e 2 G such that (e 1 ,e 2 ) = 
(e 2 ,J z e 2 ) = 0; then ei, J z ei, e 2 , J z e 2 are mutually orthogonal. Continu- 
ing this process, we obtain a basis for with an even number of vectors. 

Now assume (z,z) = —A 2 < 0, so J 2 = X 2 I. This implies that = 
ker( J z + XI) 0ker( J z — XI) . One may show that ker( J z + XI) and ker( J z — XI) 
are complementary null subspaces; cf. [9] for such an argument. Again, we 
find dim d is even. 

For the rank of J z , let 7^ z G 3 be null and assume that J z x = 0. 
Write z = z t — z s where z t is timelike, z s is spacelike, and z t _L z s . By 
assumption, J Zt x = J Zs x. By Lemma 1.11, (J Zt x, J Zg x) = (z t , z s )(x, x) = 
on the one hand, and (J Zt x, J Zs x) = {J Zt x, J Zt x) = (z t , z t )(x, x) on the other. 
Hence x is null and ker J z is a null subspace of D. Thus there exists a 
complementary null subspace 0'. Consider the subspace ker J z © 0'. Note 
that J z C ker J z since J| = 0. Now, J z (ker J z © 0') = J z o' and dim J z d' = 
dimo' = dim ker J z so J z o' = J z = ker J z . Therefore X> = ker J z © d' and 
rk J z = dim t)' = | dim D . □ 
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Let 7 be a geodesic with 7(0) = 1 and 7(0) = z Q + x a G 3©0, respectively, 
and let J = J ZQ = ad\ z . If 7 is not null, we may assume 7 is normalized 
so that (7,7) = ±1. As usual, Z* denotes the set of all integers with 
removed. 

Theorem 2.3 Let 7 be such a geodesic in a pseudoH -type group N with 

1. If (z ,z ) = a 2 with a > 0, then 7(to) is conjugate to 7(0) along 7 if 
and only if 

2ir 

to G — U Ai U A 2 
a 

where 



A 1 = | 
= jt € E 



at 



{x , x ) y cot y = (7, 7) I and 
(x , x ) 



(7,7) + (z ,z ) 



sin at > when dim 3 > 2. 



If t G (2vr/a)Z* ; t/ien 

mult cp (t ) = I 
//to i (27r/a)Z* ; t/ten 

mult cp (i ) 



dimt)-l if (7,7) + (z ,z ) / 0, 
dimn-2 z/ (7, 7) + (z , ^o) = . 



1 z/ t G A x — A 2 , 
dimj — 1 if t G A 2 - A 1 , 
dim 3 i/ t G A x n A 2 . 



2. If (zo^o) = — fl 2 with (3 > , t/ien 7(t ) is a conjugate point along 7 
if and only if t G Bx U B 2 where 



Bx = I 

= |t el 



t G 



/?t 



(a;o,x ) ycothy = (7, 7) I and 
(x , x ) 



(7,7) + (z„,zo> 



sinh/3t > w/ien dim 3 > 2 . 



The multiplicity is 

mult cp (t ) 



1 if t G Bx - B 2 , 
dim3-l i/t GB 2 -Bx, 
dim3 i/t GBxnB 2 . 
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3. If (z , z ) = 0, then j(t ) is a conjugate point along 7 if and only if 

, 12 
° ^o^n)' 

and mult cp (t ) = dim 3 — 1. 

Together with Theorem 1.10 [8, 2.2], this covers all cases for a pseudoi^-type 
group with a center of any dimension. The proof occupies Section 3. 

Here is our generalization to pseudoregular groups of Eberlein's theo- 
rem for nonsingular groups [5, Thm. 6.1]. We note that O'Neill [14, Ex.9, 
p. 125] has extended the definition of totally geodesic to (possibly) degener- 
ate submanifolds of pseudoriemannian manifolds. We shall use this extended 
version. 

Theorem 2.4 Let N be pseudoregular. For every geodesic 7 with 7(0) = 
1 € N and 7(0) = z + x with \z \ / there exists a connected, totally 
geodesic, 3-dimensional submanifold H such that 7(0) G rj = T X H and f) H 3 
is nonnull, if and only if the metric tensor on N is homothetic to one of 
pseudoH -type. 

The proof is found in Section 4. 

To show that pseudoregular is necessary, here is a group that satisfies 
condition (2), but not condition (1), of Definition 1.2 and the hypothesis 
supra about totally geodesic submanifolds, but is not homothetic to one of 
pseudo-ff-type. 

Example 2.5 Let N be the unique, simply connected, 2-step nilpotent Lie 
group with Lie algebra n = [ei,e 2 ] ® [zi,z 2 ]], structure equation [ei,e 2 ] = 
Z\ — z 2 , and nontrivial inner products 

(ei, ei) = (e 2 , e 2 ) = 1 , 

{z 1 ,z 1 ) = -(z 2 ,z 2 ) = 1. 

One readily computes J% 1+Z2 = —4/, but Z\ + z 2 is null so TV is not of 
pseudo.ff-type, nor even homothetic to one. 

It is easy to see that it satisfies condition (2) of Definition 1.2, and 
ad ei is clearly not surjective so condition (1) fails to hold. Thus N is not 
pseudoregular. With a bit more effort, one may show that for every geo- 
desic 7 with 7(0) = 1 € N there exists a 3-dimensional, totally geodesic 
submanifold H such that 7(0) £ T±H. Indeed, if 7(0) = z a + x then 
H = {exp 1 (ax + bz\ + cz 2 ) \ a,b,c G M} where we use the pseudorieman- 
nian (geometric) exponential map, not the Lie group one. In fact, such an 
H is totally geodesic for any x G 0. 
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3 Proof of Theorem 2.3 

For the first part, assume Y(t) = z(t) + e tJ u{t) is a nontrivial Jacobi field 
along 7 with Y(0) = Y(t ) = 0. Then by Proposition 1.8, we may assume 
that 



for a constant c and a constant vector ( € 3 with (z , C) = 0. 
The general solution of equation (3.2) satisfying u(0) = is 

u(t) = ctx + (e~ tJ - I)v - - 1 A e- 2tJ - e- u )J ( x (3.3) 

*\Zq, z o) 

for some v G 0. To get this, we used the fact that e~ tJ = J^e* J ; this 
follows from item 3 in Lemma 1.11. 
Assume that 



z(t) - [e tJ u(t),x'(t)} =cz + ( 
e tJ il(t) + e tJ Jii(t) - J CZQ+C x'(t) = 



(3.1) 
(3.2) 




(3.4) 



Then from (3.3) we have it (to) = ctoX = whence c = 0. Thus 



and from (3.1) and (3.5) 




(3.5) 



z(t) + [(e tJ - I)v ,x'(t)] - — !— , [( e -« _ /) Jf XOj = C . 

^\-Zo, ^0/ 



Using 



e * J = (cos |z |t) / + 1 — r (sin |z |t) J, 



\ z o\ 



this becomes 



z(t) — v , cos \z \t x + - — r sin \z \t Jx 



+ cos |zo|ti>o + 1 — f sin |z |t Jv , cos |2 |i£o + — f sin |z |t Jx, 








+ — cos \z \t JqXq — 1 — r sin \z \t JJ^x , 



2(^0)^0/ L ' \zo\ 



cos U |t x + 1 — r sin |z |i Jx 



— J c x ,cos \z \tx + ■; — rsinlzoltJxo = C- 

2{zo,z ) L \zo\ J 
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Also from Lemma 1.11, we get [J^x ,Jx ] = [JJ^x ,x ] and [JJ^x , Jx Q ] = 
(x , x a ) (z , z q }(. Together with some computation, these yield 

z(t) + (cos 2 \zo\t - cos \z \t) [v Q ,x Q ] 

+ (cos |z |tsin \z \t - sin \z \t) [v Q , Jx a ] 
\ z o\ 

+ | — r sin|z |icos \z \t [Jv ,x ] + | — pjsin 2 \z \t [Jv , Jx ] 
Fo| \zo\ 2 

+ ^(Z ~ r (cos |^o|* - cos 2 \z \t) {x ,x )( 

sin \zo\t [J ( x Q , Jx Q ] - — — — -sin 2 \z \t(x ,x )( = (. 



2(z Q ,z ) ' 2(2:0,2:0) 

Integrating under z(0) = 0, 

z(t) + Q + sin2|z |i - j-^j sin \z \tj [v ,x ] 
+ |7]2 ( cos l^o I* - jcos2\z \t - I) [v , Jx ] 

+ \^{l~izV\ S[n2lZolt ) [JV °' JXo] 

+ ^(l-cos 2 |, |,)[^,o] + |^(^ S in|2o|,-,)c 
+ (cos \z \t - 1) [J ( x , Jx ] = t£ . (3.6) 

If (z , z') = for some z 1 G 3, then 

([vo,x ] + |^-|^[Ju , Jx ],z') = ([v ,x ],2:'} + |-^([Jw , Jxo]^') 

= (Jz'V ,X ) + j—^([J z >Jvo,Jx ) 

= (J x ,v ,x ) - j^([JJ z ,v ,Jx ) 

= (J z >v a ,x ) - (J z ,v ,x ) 
= 0. 



This implies that 



[vo,Xo] + -^-tAJvqtJxq] = -2 ^ Vo,Jx °^ 2 
\z \ 2 {z ,z ) 
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Substituting into (3.6), 
z(t) = 

— sin |^o|* — 4j7]" sin2 l z °l*) l v o> x o] 

+ |7]2 (\ cos2 \ z o\t ~ cos \zo\t + |) [v , Jx ] 

+ ( cos2 l^o I* - 1) [Jv ,x ] + -^-^sm2\z \t[Jv ,Jx Q ] 

I f (xo,x ) + 2(z ,z ) (xo,x ) \ (vo,Jx ) 

Since z(t ) = 0, this gives 

^ / (v Q ,Jx Q ) ^ + {x ,x ) + 2(z ,2: ) A = Q 
° V (z ,z ) ° 2(z Q ,z ) J 

which implies that (v , Jx ) = and ({x , x ) + 2(z , z Q }) C = 0. 

If (x ,x ) + 2(z ,z ) / 0, then C = 0. Now (3.5) and (3.1) yield u{t) = 
(e* J — /) v with (v , Jx ) = 0, so (3.7) simplifies to 

Z ^ = {jz~\ sin l z °l t ~ 4j^ sin2 ' Z °'*) [ u °' x °] 

+ j~|2 (l C Os2|z |t - COS \z \t + I) [V ,JX ] 

+ 7T~i2 ( cos2 l^o I* - 1) [Jv ,x ] + -7—^sm2\zo\t[Jv ,Jxo] ■ 
4po| 4 l z o| 

It readily follows that mult cp (t ) = dimo — 1 as claimed. 

If (x , x ) + 2(z , z ) = 0, then similarly 

1 

2(z ,z ) 



u(t) = (e u -I)v - (e~ 2tJ - e' tJ ) J c x , 



Z ^ = (^T~~T sin l^o I* - sin 2|^ |^ [v ,x ] 



W 4|zo| 
+ j7]2 (l c os2|z |t - cos \z \t + I) [v , Jx ] 

+ (cos 2 |^o|* - 1) [Jv ,x ] + -^-^sm2\z \t[Jv a , Jx ] 
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and it follows that mult cp (i ) = dime — 1 + dimj — 1 = dimn — 2 as desired. 
Now assume that 

27T 

t i —Z*. (3.8) 

If cz + ( = in (3.2), then we have u(t) = (e~ tJ — I)v for a constant vector 
v £ 0. Since ti(to) = (e~* oJ — /)f = 0, by our assumption (3.8) we must 
have v = 0, which implies that u{t) = 0. This and (3.1) with z(0) = 
imply that z(t) = for all t. Thus Y = 0, contradicting the nontriviality of 
Y . Therefore cz + £ 7^ 0. 

From (3.3), u(t ) = 0, and (3.8), 

u(t) = ctx - (e' tJ - I)(e- toJ - I^ctoxo 

+ 2{^o) ^ " /)(e "° J " e ~ tJ) JCX ° ' (3 ' 9) 
Substituting into equation (3.1) we get 

z(t) + [(/ - e* J )(e-* oJ - iy'ctoxo, x'(t)] 

1 [{I - e tJ ){e- taJ -e- tJ )J c x ,x'(t)} = cz + ( . 



2(^0) z o) 
Using the identities 



2* J = (cos \ z \t) I + — !— (sin |z |t) J , 



this becomes 



ct / |^o 1*0 .11. 1 1, , \zo\to 



z{t) + (^ cot — ^ sin |z |i - cos |z |icot — — J [x , Jx ] 

- 2 ^ ^ sin |z |t (cos |z |t - cos \z \t - cos \z Q \(t - t ) + l) [J c x , Jx ] 
- 2 ^ | 3 cos |z |t (sin |z |i - sin |z |t - sin |z |(t - t fj [JJ c x ,x ] 
- 2 ^ | 2 cos \z \t (cos I ^0 |*o - cos |z |t - cos |z |(* - *o) + l) [J(X a ,X ] 
- 2 ^ | 4 sin |z |i (sin|z jt - sin \z \t - sin \z \(t - i )) [JJ c x , Jx ] 

= CZq + C 



12 



Using Lemma 1.11 and the identities we derived from it earlier, this 
becomes 

m = 

r (x ,xo)t ( ,\z \t a i i , i i , , kol*o\\ 

c|l ^-j — ^cot — sin \z \t - cos \z \tcot — ^— J j z 

+ |l + (l - cos \z \{t - t ) + cos \z \{2t - t ) - cos \zo\t) I C 

+ 2 | * | 3 { sin |z |(t - t ) - sin [z |(2t - to) + sin |2 |i} [JJ c x ,x ] . 
Integrating both sides under z(0) = yields 

z(t) = c (t - cot _*+_ COS |, |t 

1 1 . , ,. . \zo\t \\ 

+ {t + ^jjr (t - |^| sin ko|(* - *o) + 2|^| sin l z o I (2* - to) 
-^sin|. |t-^sin|, |to)}c 

~ Jz~\ cos ' z °l t + 2ji~| C ° S ' Z °' to + i JJ C x o, x o] ■ 

Since 2; (to) = 0, we find 

z(f) _ ct o J, v , \ (xo,x )|z |to |z |t ) 

— |^ | 2 I \ Z 0) ^0/ T \^0) Xq) COt j Z 

+ ^{((7,7) + (^o^o})to-^j^sin|z |to}c = 0. 
If C = and c / 0, then 



(7,7) = (^0,^0) -^7!^ cot 



If C 7^ and c = 0, then 



\zo\to = ( x O'^o) s i n | Zo |f 
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If C + and c / 0, then 



(7,7) = (xo,Xo) 



z O 

2 



cot 



^0 1^0 

2 



^0 1*0 



(Xq,X ) 



sin|z |t . 



(7,7) + {z ,z } 



Thus we have shown that if 7 (to) is a conjugate point along 7 and t Q ^ 
(2ti7>o|)Z*, then t G A : U A 2 . 

Note that u and z are uniquely determined by the constants c and (. 
Thus we have these multiplicities: 

1. if t £ Ax — A 2 , then mult cp (t ) = 1; 

2. if i G A 2 — Ai, then mult cp (i ) = dimj — 1; 

3. if t G Ai (~l A 2 , then mult cp (t ) = 1 + dimj — 1 = dimj. 

The proof of the second part of Theorem 2.3 is similar. 

For the third part, let Y(t) = z(t)+e tJ u(t) be a Jacobi field with Y(0) = 
Y(t ) = 0. Then by Proposition 1.8 we have 



where c, d are real constants and (, £ are constants in 3 such that (z , C) = 1> 



Since J 2 = — (z 0) ^oH = 0> (3-H) reduces to 

(/ + tJ)u + Ju = cJx + dJ^x + J^x + (td)J^Jx + t.J^Jx ■ (3.12) 

Note that the solution u of (3.12) satisfying u(0) = u(t ) = is unique (if it 
exists) . 

Consider the vector field u along 7 given by 

u(t) = a x + «i Jx + a 2 J c x + a 3 JJ c x + ftJ^ + /? 2 JJ 5 x 



i(t) - [e* J n(t),x'(t)] =cz + dC + ^, 



(3.10) 



(CO = 0, (z ,e) = (C,0=0, and 



e tJ ii(i) + e tJ Ju(t) - J CZ0+dC+i x'(t) = . 



(3.11) 
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where 

a = ft(t 2 -t 2 ), 

ai = %t{t - t ) + £t(3t 3 - 2t 2 t - t 3 ) , 

a 2 = - t ) , 

a 3 = it(t + 2t){t -t), 

(3, = \t{t - to) , 

02 = \t{t + 2t)(t -t). 

By a direct computation using Lemma 1.11, this u is a solution of (3.12). 
Since u(0) = u(t ) = 0, it is the unique such solution. 
Now we compute 

[e tJ u(t),e tJ Xo] = [(I + t.J)u, (I + tJ)x ] 

= [u, x ] + t[Ju, x ] + t[u, Jx ] + t 2 [Ju, Jxo] 
= ai[Jx ,x ] + a 2 [J(Xo,x ] + a 3 [JJ c x , x ] 
+ (3i [J^Xq, x a ] + 02 [J J^x , x Q ] 
+ t(a [Jx ,x ] + a 2 [JJ c Xo,x ] + /?i[JJ € x ,^o]) 
+ t(a [x , Jxo] + a 2 [J c x , Jx ] + a 3 [JJ c x , Jx ] 
+ /3i[J ? x , Jx ] + 2 [JJ i x o , Jx ]j 
+ t 2 (a 2 [JJ c Xo, Jx ] + /?i[JJ 5 x , Jz ]) . 



Observe that 



and 



[JJ C Xo,Xo] = [J c Xo,Jx Q }, 
[JJ ( Xo,X Q ] = [J ( Xo,JXo], 

[JJ c Xo,Jxo] = [(-J c Jx -2I)xo,Jxo] 
= {Jxo,Jx )(-2[xo,Jxo] 
= -2(x ,x )zo, 

[JJ^Xo, Jxo] = — [Jit Jxo, Jxo] 
= [Jxo, J^J Xo] 
= (Jxo,Jx )£ 
= 0. 
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Thus 

[e tJ u(t),e tJ x a ] 

= -(x a ,x )aiz - (x ,x )a 2 ( + (a 3 + 2ta 2 )[JJ c x , x ] 

- (x ,x )/3iC+ (#2 + 2t(3 1 )[JJ i x ,x Q ] 

— 2ia 3 (x , Xo)z — 2i 2 a 2 (xo, x )zo 

= -(x , x )(ai + 2ta 3 + 2t 2 a 2 )z - (x , x )a 2 C - (x , x }/?i£ 
+ (a 3 + 2ta 2 )[JJ c x ,x ] + (J3 2 + 2t/3 1 )[JJ 5 x ,x ] . 

From this and (3.10), we get 

z(t) + (x ,x )(ai + 2ta 3 + 2t 2 a 2 )z + (x ,x )a 2 C 
+ {x ,x )P 1 ( t + (q 3 + 2to 2 )[JJ c x ,x ] 

+ (fa + 2i/? 1 )[JJ c x , x ] = cz + + £ • 

Integrating under z(0) = 0, 



+ <*o, zo>{|(§* 3 - \t%) + d - \t\ + h% - ±tH^j I 



d(x ,X ) , x 3 l , 2 , \ > (Xo,X ) , j 3 j 2, \ e 
H ^ V3* ~ 2* f 0J ^ H o U* ~ 2* ? 

x9r T T 1 1 



2 V3 2 7 ' 2 
+ ^t 2 (i - t ) 2 [JJ c x ,x ] + -i 2 (i - t ) 2 [JJ 6 x Q ,x ] 

= {cz + dC + £)t 

Using z(t ) = 0, from this we get 

-(^o, x ) (Jjtl + Y^o) zo~(x ,x )4 C-^j^t 3 e = (cz + dC + to 

which implies that d = and — (x , x )t 2 /12 = 1. Thus 

u(t) = |t(t - t ) Jx + |t(t - to)«/?x + |t(t + 2t)(t - t) JJ^Xo , 
z(t) = ct{l- (x , x )t{\t - \t )} z Q + t{l- (x , x Q )t(\t - \t )} £ 
- -t 2 (t-t ) 2 [JJ^x ,x }. 

Note that u and z are uniquely determined by c and £. Hence mult cp (t ) = 
dimj — 1. 
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4 Proof of Theorem 2.4 



Lemma 4.1 Let N be a pseudoriemannian, 2-step nilpotent Lie group with 
nondegenerate center. If [x, J z x] = cz for some real c for every nonnull 
x £ and z G 3, then there exists a self adjoint operator A on such that 
J\ = (z, z)A for all z G 3 

Proof: Sfep i: [x, J z x] = cz for every x G and every nonnull z £ }, 
Suppose \x\ = 0. Then there exists a null d £ C such that (x,v) 7^ 0. Note 
x + av is nonnull for every nonzero scalar a. Thus 

[x + av,J z (x + av)] = c a z (4.1) 
[x — av , J z (x — av)] = C- a z (4.2) 

where c± a are constants. From these equations, we get 

[x,J z x] +a 2 [v, J z v] = \(c a + c- a )z. 

Since a is arbitrary, 

[x, J z x] G [z] . 

iSfep 2: J Z J Z > + J z '«/ Z = for every mutually orthogonal pair of nonnull 
vectors z, z' in 3. By Step 1, we have 

[x + v, J z (x + v)] = cz 

for all x,!) £ 0. Thus 

<J z /(a; + «), J z (rc + «)] =0. 

This implies 

(J z /X, J Z X) + ( J z /X, J z v) + (J z ,v, J z x) + (J z ,v, J z v) = , 

so 

(-J z J z ,x,x) + (-J z J z >x,v) + (-J z ,J z x,v) + (-J z J z >v,v) = 0. 

Now 

= {-z,dz') 
= 
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for some scalar d. Substituting this result into the previous equation yields 

((J z Jz> + J z 'Jz)x,v) = 0, 
which implies the desired conclusion. 

Step 3: Jl = Jl if + (z, z) = (z 1 , z') and z 1 z' . By Step 1, 

[x, J z+Z >x] = c(z + z') 

for all x € 0. This implies 

(Jz-z' x i Jz+z'X) = 

whence 

(J z x, J z x) - (J z ,x, J z x) + (J z x, J z ,x) - (J z ,x, J z ,x) = 

so 

(J z x,x) = (J z ,x,x) . 

Thus, for all x,v £ X>, 

{J 2 z {x + v),x + v) = {Jl{x + v),x + v) 

whence 

(J z x,v) = (J z ,x,v) 

and therefore 

j z = Jz' • 

Step 4: P z = - Jl if ^ (z,z) = -{z',z') and z J_ z' . By Step 1, for all 
x G 0, 

[a^+iz'z] = ci(z+ i/), 

[x, J^x] = C2Z , 

[x, Ji z ,x] = c z \z . 

From these we infer 

(J z x,J z x) = c{z,z) 
{J z .x,J z >x) = c(z',z') 



18 



so 

(-J 2 z x,x) + {-J 2 z ,x,x) = 
((J 2 z + J 2 z ,)x,x) = 

and therefore 

J z = ~~ J z' • 

Step 5: for an orthonormal basis {zi} of 3 such that (z\, Zi) = ■ ■ ■ = (zi, z\) = 
1 and (zi+i,Zi +1 ) = ■ ■ ■ = (z k , z k ) = — 1 and J Zi = A, then J z = (z, z)A for 
all z£j. Expand z in the basis {z { } as z = J2i a i z i- Then 

Jz = Yl a * J ^ J2 a * Jz > 

i i 

= Y. a Vl by Step 2 

l k 

= a 1 J li - Yl a ^ J l b y ste P s 3 and 4 

i=l i=l+l 

= It* - £ A % 

\i=l i=J+l / 

Lemma 4.2 Lei iV be pseudoregular. For a nonzero x G and a nonnull 
z G 3, if x, J z x, J z x are linearly dependent and x,J z x are linearly indepen- 
dent, then x is null. 

Proof: By assumption, we can find constants a, b, c, not all zero, such that 
ax + b.J z x + cJfx = 0, and we may assume that a / / 6 since x and a; 
are linearly independent. Since 

ker (al + bJ z + cJ z ) n ker (a/ - 6J Z + cJ z ) = , 

the map 

al - bJ z + cJ z : ker (al + bJ z + cJ z ) -> ker (a/ + 6J Z + cJ z 2 ) 

is nonsingular. Thus we may choose v <G ker (al + b J z + cJ z ) such that 
(a/ — bJ z + cJ z ) v = x, so 

(x,x) = ((al — bJ z + cJ z ) v,x) 

= (v, (al + 6J Z + cJ 2 z ) x) 

= (v,0) 

= 0. n 
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Proof (Theorem 2.4): We first prove the "only if half, proceeding by 
steps and cases. Step 1: [x, J z x] = cz for all nonnull z G 3, x G 0. Suppose 
the contrary. Then there exist nonnull z G 3, x G such that [x, J z x] ^ [zj. 
Consider the geodesic 7 such that 7(0) = 1 G iV and 7(0) = z + x. Then 
there exists a connected, totally geodesic, 3-dimensional submanifold H with 
7(0) G f) = Ti# and fj ["13 nonnull. Choose z' G f) H 3 with (z', z'} / 0. Then 
by the Gauss equation, we have R(x + z,z')z' = —\J z ,x G f) or J z ,x G h. 
Similarly, J^,x G f). 

Case Li: J z ,x and J z ,x are linearly independent. Then it follows that 
f) = [z', J|,x, J^,x|. This implies that x, z G fj and z and z' are linearly 
dependent. By the Gauss equation, R(x,z)x = — \[x,J z x] G f). This and 
f) = [z, Jf x, J z x\ imply that [x, J z x] G [z], a contradiction. 

Case 1.2: J z ,x and J\,x are linearly dependent. This and the nonsingu- 
larity of J z , imply that x and J z ,x are linearly dependent, whence x,z G f). 

Subcase 1.2.1: z and z' are linearly independent. Then f) = [x, z, z']. By 
the Gauss equation, R(x,z)z = —\J Z G i) so J|x = cx for some constant 
c, and R{x,z)z' = —jJ z J z /x G h so J z J z >x = dx for some constant d 7^ 0. 
Thus adj.(z - |z') = 0. This implies ([x,v],z - - d z') = for all dB. But 
this contradicts N being pseudoregular. 

Subcase 1.2.2: z and z' are linearly dependent. Then t) = [x,z,Zi + xj 
for some 21 + ^1 £ 3 (B t). Ifx and X\ are linearly dependent, then f) = 
[x, z, zi] and an argument similar to that of the preceding subcase yields a 
contradiction. Thus we assume that x and x 1 are linearly independent. By 
the Gauss equation, R(x, z)x = — |[x, J z x] G I) which implies that [x, J z x] G 
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Therefore [x, J z x] G [z] for all nonnull z G 3, x G 0. 

Step 1 and Lemma 4.1 imply that J z = (z,z)A for all z G 3 for some 
fixed, selfadjoint operator A on 0. 

S'tep 2: A = XI for a nonzero constant A. Suppose the contrary; then we can 
choose nonnull z G 3 and x G such that x and J z x are linearly independent. 

Consider a geodesic 7 emanating from 1 G N with 7(0) = z + x. Then 
there exists a totally geodesic submanifold H with 7(0) G T X H = I) and f) P13 
nonnull. Choose a nonnull z' G f) PI 3. By the Gauss equation, J|,x, J z ,x G f). 
By Step 1, J z ,x = cJ z x and J z ,x = c 2 J z x. Since x and J z x are linearly 
independent, so are J z ,x and J^,x. Also, 7(0) = z + x G f) whence f) = 
[z, Jfx, J z xj = {z,x,J z xj. Using = (z,z)A, it follows that [x,J z x] = 
for all z G 3. 

Now consider a geodesic 7 emanating from 1 G N with 7(0) = x. Then 



20 



7 lies in H, ^(t) = exp(tx), x and J 2 x are parallel along 7, and so there 
exists a parallel vector field az + (3J z x along 7 where a(0) = 1 and /3(0) = 0. 

Case 2.1: [x, J z x] = cz for c = I 2 with / > 0. Then (cos f )z+(y sin j)J z x 
is the desired parallel vector field. Applying the Gauss equation at the point 
7(t) = exp(ix), we obtain 

R(x, az + f3J z x)x = aR(x, z)x + (3R(x, J z x)x 
= -\a[x, J z x) + jf3J[ x j zX] x 
= —jcaz + jc(3J z x £ [x, + (3J z x, J z x} . 

Thus we can write — jcaz + jCj3J z x = S\X + s 2 (az + f3J z x) + s 3 J 2 x for 
suitable constants Sj. Then s 2 = — \c and Six — c(5J z x + s 3 J 2 x = 0. Since x 
and J^x are linearly independent, Lemma 4.2 implies that x is null, which 
is a contradiction. Thus this case cannot happen. 

Case 2.2: [x,J z x] = cz for c = -I 2 with I > 0. Then (cosh f )z + 
(jsinh^)J z x is parallel along 7. By a similar argument to that of the 
previous case, we have another contradiction. 

Case 2.3: [x,J z x] = 0. This condition implies (x,J 2 x) = 0. Since x, 
J 2 x, and J*x are linearly dependent, there exist constants / a, b, c / 
such that ax + 6J|x + cJ^x = 0. This implies that {ax + b.J 2 x + cJ z x,x) = 
whence a(x,x) + c(J z x,x) = 0. Since (x,x) 7^ 0, (J z x,x) 7^ 0. 

Now z + \tJ z x is a parallel vector field along 7. Applying the Gauss 
equation, 

R(J 2 x,z + \tJ z x)J 2 z x 

= -\[ J z x > J zx] + ft ad* [Jf x, J z x] G [x, J z 2 x, z + \tJ z x\ , 

and we know that R(J 2 x, z)J 2 x = — j[J z x, J z x] G f). This last implies that 
[J 2 x, J z x] = cfe for some constant d. Since (x, x) 7^ 0, we have d / 0. 
Thus 

-±eb + |tciJ z x G [x, J 2 x, z + ^ J z xj 
so there exist constants Sj such that 

+ |tdJ z x = six + s 2 Jfx + s 3 (z + \t,J z x) , 

whence s 3 = — \d and Six — \tdJ z x + s 2 J z x = 0. But the last equation 
contradicts Lemma 4.2. 

Therefore we conclude that A = XI. The "only if" half now follows, —A 
being the required constant of homothety. 
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Conversely, assume that N is nomothetic to one of pseudoii-type and 
consider a geodesic 7 with 7(0) = 1 G N and 7(0) = z + x . We may as 
well assume \z \ / 0. 

If Xq = 0, then choose a nonzero i£t) such that x and Ja; are linearly 
independent. It follows that H = exp[z , x, Jx} is a 3-dimensional, totally 
geodesic subgroup of N with 7(0) G T X H as desired. 

Now assume x 7^ 0. If x and Jx are linearly independent then, almost 
as before, H = exp[[z , x , Jx J is a suitable subgroup. If x and Jx are 
linearly dependent, then there exists a nonzero scalar d such that Jx a = dx . 
Now it follows that J 2 = cPl, so t> can be decomposed as D = ker(J — 
dl) © ker(J + dl). One may show (as in [9], for example) that ker(J — dl) 
and ker(J + dl) are complementary null subspaces of 0. Thus we may 
choose y £ ker(J + dl) such that {x ,y} = 1. Letting {z , Zi, . . . , z k } be 
an orthogonal basis of 3 and using JJ Z . + J Zz J = for i / from Lemma 
1.11, we find { J z x | z G [21, ■ ■ ■ , z*;]} C ker(J + (if). So (J Zz x , y) = for 
1 < z < A; since J Zt x a ,y G ker(J + d/). Therefore [x ,y] = (d/(z , z ))z . 
This implies that = exp[[z , x , is a 3-dimensional, totally geodesic 
subgroup with 7(0) G TiH as required. □ 
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